BOUNDING THE SUPPORT OF A MEASURE FROM ITS 
MARGINAL MOMENTS 



JEAN B. LASSERRE 

Abstract. Given all moments of the marginals of a measure /i on R™, one 
provides (a) explicit bounds on its support and (b) a numerical scheme to 
compute the smallest box that contains the support of fi. 



1. Introduction 

Inverse problems in probability are ubiquitous in several important applications, 
and among them shape reconstruction problems. For instance, exact recovery of 
two-dimensional objects from finitely many moments is possible for polygons and 
so-called quadrature domains as shown in Golub et al. [5] and Gustafsson et al. 
[6], respectively. But so far, there is no inversion algorithm from moments for n- 
dimensional shapes. However, more recently Cuyt et al. [4] have shown how to 
approximately recover numerically an unknown density / defined on a compact 
region of R™, from the only knowledge of its moments. So when / is the indicator 
function of a compact set A C M" one may thus recover the shape of A with good 
accuracy, based on moment information only. The elegant methodology developed 
in [4] is based on multi-dimensional homogeneous Pade approximants and uses a 
nice Pade slice property, the analogue for the moment approach of the Fourier 
slice theorem for the Radon transform (or projection) approach; see [4] for an 
illuminating discussion. 

In this paper we are interested in the following inverse problem. Given an arbi- 
trary finite Borel measure fj, on R™ (not necessarily having a density with respect 
to the Lebesgue measure), can we compute (or at least approximate) the smallest 
box rir=i[ a *'^] ^- ^™ w hich contains the support of [i (not necessarily compact), 
from the only knowledge of its moments? 

Contribution. Obviously, as we look for a box, the problem reduces to find 
for each i = l,...,n, the smallest interval [aj,6j] (not necessarily compact) that 
contains the support of the marginal fa of fi. Of course, to bound <ij and bi, one 
possibility is to compute zeros of the polynomials (pd), d € N, orthogonal with 
respect to the measure fa. Indeed, for every d, the smallest (resp. largest) zero 
of pd provides an upper bound on a, (resp. a lower bound on bi), and there is a 
systematic way to compute the pd's from from the given moments of fa see e.g. 
Gautschi §1.2 and §2.1]. 

Our contribution is to provide a convergent numerical scheme for computing this 
smallest interval [a, , bi] , which (i) is based on the only knowledge of the moments of 
the marginals fa, i — 1, . . . ,n, and (ii) avoids computing orthogonal polynomials. 
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For each i, it consists of solving 2 hierarchies (associated with each of the end points 
as and bi) of so called semidefinite program)^ in only one variable (and therefore 
those semidefinite programs are generalized eigenvalue problems for which even 
more specialized softwares exist). Importantly, we do not make any assumption 
on [i and in particular, /i may not have a density with respect to the Lebesgue 
measure as in the above cited works. In solving the two semidefinite programs 
at step d of the hierarchy, one provides an inner approximation [a,d,bd] C [ffl»,&t] 
such that the sequence [a a) (resp. (bd)), d G N, is monotone nonincreasing (resp. 
nondecreasing) and converges to a, (resp. to bi) as d — > oo (with possibly dj = — oo 
and/or bi = +00). Interestingly, some explicit upper (resp. lower) bounds on <ij 
(resp. bi) in terms of the moments of jii are also available. 

2. Notation and definitions 

Let N be the set of natural numbers and denote by x = (x\ , . . . , x n ) a vector of M" 
whereas x will denote a scalar. Let M[x] be the ring of real univariate polynomials in 
the single variable x, and denote by K[x]<j the vector space of polynomials of degree 
at most d. Let S[x] C R[x] be the set of polynomials that are sums of squares 
(s.o.s.), and H[x]d its subspace of s.o.s. polynomials of degree at most 2c?. In the 
canonical basis (x k ), k = 0, . . . , d, of K[a;]d, a polynomial / G M\x]d is written 

d 

x i-> /(a;) = ^/fe^, 

for some vector f = (/*,) 6 

Moment matrix. Given a infinite sequence y := (yk), k G N, indexed in the 
canonical basis (x k ) of R[x], let ELj(y) e M( d + 1 )x( d + 1 ) be the real Hankel matrix 
defined by: 

(2.1) H d (y)(i,j) = Vi+j-2, Vi,j<d. 

The matrix H c ;(y) is called the moment matrix associated with the sequence y (see 
e.g. Curto and Fialkow \Z 1 and Lasserre [7]). If y has a representing measure /x 
(i.e., if there exists a finite Borel measure n such that yu = J x fc d/i for every k € N) 
then 

(2.2) (f,H d (y)f) = /" /(x) 2 d M (x) > 0, V/ G R[x]d, 

so that Hd(y) h 0, where for a real symmetric matrix A, the notation A ^ (resp. 
A y 0) stands for A is positive semidefinite (resp. positive definite). 

Localizing matrix. Similarly, given 8 6 R[x] s with vector of coefficients (Ok), let 
Hd(^y) G ]R( rf + 1 ) x ( <i + 1 ) be the real symmetric matrix defined by: 

s 

(2.3) n d (0y)(i,j) ■= Y, d kyi+ j+ k-2, Vi,i<d. 

fe=0 

The matrix Hrf(0y) is called the localizing matrix associated with the sequence y 
and the polynomial 8 (see again Lasserre [J). Notice that the localizing matrix 
with respect to the constant polynomial 6 = 1 is the moment matrix H,j(y) in 

semidefinite program is a convex optimization problem that can be solved (up to arbitrary 
but fixed precision) in time polynomial in the input size of the problem, and for which efficient 
public softwares are available; see e.g. [9] 
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()2.1j) . If y has a representing measure /j, with support contained in the level set 
{i(El: B(x) > 0}, then 

(2.4) <f,H d (0y)f> = J f(x) 2 9(x)dfi(x) > V/6R[i] d , 

so that H d (0y) h 0. 

Finally, for a finite Borel measure [A, denote its support by supp ^i, that is, supp fi 
is the smallest closed set B such that /i(£> c ) = (where B c denotes the complement 
oiB). 

3. Main result 

We may and will restrict to the one-dimensional case because if fi is a finite Borel 
measure on R", and if we look for a box B := nr=i[ ai > such that supp/x C B, 
then we have the following result. For every i = 1, . . . , n, let /Xj be the marginal of 
\x with respect to the variable a;,-. 

Lemma 3.1. Let B C R n be the box rL=i[ a i>^] with possibly a, = — oo and/or 
bi = +oo. Then supp /iCB n/ and on/y if supp /Uj C [a.;, bi] for every i = 1, . . . , n. 

Proof. For every i = l,...,n, let Ai C R n be the Borel set {x G R™ : ^ e 
M.\ [a,i,bi]}. Then — \i{Ai) = /Ltj(R \ [aj,6j]), shows that supp/i^ C [aj,6j], i — 

1. . . . , n. Conversely, if /j.^ C [a,-, 6j], i = 1, . . . , n, then = \ [a%, bi]) = /j,(Ai), 
i = 1, . . . , n. But since B c = U™ =1 Ai we also obtain /x(B c ) = 0. □ 

So Lemma 13.11 tells us that it is enough to consider separate conditions for the 
marginals /i;, i — 1, ...,n. Therefore, all we need to know is the sequence of 
moments 

yi-= J XiM*) = J x k dfii(x) : k = o,i,... 

of the marginal \ii of /it, for every i = 1, . . . , n. 

Hence we now consider the one-dimensional case. For a real number o, let 
9 a G M[x] be the polynomial x n- 9 a (x) = [x — a). Recall that the support of 
a finite Borel measure n on K (denoted supp /x) is the smallest closed set B such 
that //(M \ B) =0. For instance is \x is supported on (a,b] U [c, d) U {e}, with 
a<6<c<rf<e then supp fj, is the closed set [a, 6] U [c, d] U {e} and is contained 
in the interval [a, e]. 

3.1. Bounds on supp/i. We first derive bounds on scalars a and & that satisfy 
supp/i C (— oo,a] and/or supp/z C [b, +oo). 

Proposition 3.2. Let \x be a finite and non trivial Borel measure on the real line 
R, with associated sequence of moments y = (yk), k G N, all finite. Then: 

(i) supp /j, C [a, +cxd) j/ and on/j/ i/ 

(3.1) H d (0 a y)bO, Vd G N. 

(ii) supp/x C [— oo, b] if and only if 

(3.2) H d (-9 b y)h0, VdGN. 

For each fixed d G N, the condition H d (0 a y) y (resp. Hd(—0t,y) ^0) determines 
a basic semi- algebraic set of the form {(a, y) : Pdk(a,y) > 0, fc = 0, ...d — 1} 
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(resp. {(a, y) : (— 1) Pdk(b,y) > 0, k = 0, ...d— 1}) for some polynomials 

McR[i,y]. 

With y and d fixed, the condition h3.1\) (resp. H3.2\) ) yields an upper bound 
a < a d (resp. a lower bound b > bd), and the sequence (a d ) (resp. (bd)), d G N, is 
monotone nonincreasing (resp. nondecreasing) . In particular, 



(3.3) a 

(3.4) b 



< 



> max 



j/i yi + 2/3 
yo ' yo - 
yi 2/1 



2/2. 
- 2/3 



2/0 2/o + 2/2 



and a < min 
and > max 



Vi 2/3 2/i + 2/3 
2/0 ' 2/2 ' 2/o + 2/2 
2/1 2ft 2/i + 2/3 
2/o ' 2/2 ' 2/o + 2/2 



(f 2/2^0 
2/2 ^0, 



as well as 



(3.5) 
(3.6) 



< 



b > 



2/02/3 



2/12/2 - v 7 (2/02/3 - 2/12/2) 2 - 4(2/02/2 - 2/1X2/12/3 - y\) 



2(2/02/2 



2/?) 



2/02/3 



2/12/2 + V (2/02/3 - 2/12/2) 2 - 4(y 2/2 - 2/?) (2/12/3 - 2/1) 



2(2/02/2 - J/?) 

*/ (2/02/3 - 2/12/2) 2 > 4(2/02/2 - 2/1X2/12/3 - 2/D- 

Proof, (|3.ip and (|3.2[) is well-known and can be found in e.g. Lasserre Theorem 
3.2]. Next, write the characteristic polynomial t M* c(t) of H d (9 a ,y) hi the form 

d-i 

c(t) (= det(i/-H d (0 o y))) - t d + Y^(-^ k Pdk(a,y)t k , teR, 

fc=0 

for some polynomials (p<ifc) C M[a,y], and where p^fc is of degree k in the variable 
a. Then Hd(ay) ^ 0, if and only if c has all its roots nonnegative, which in turn, 
by Descarte's rule, happens if and only if pdk(a, y) > 0, for every k = 0, . . . , d — 1. 
In fact (a, y) belong to the closure of a convex connected component of {(a,y) : 
Pdo(a,y) (= det Hd(0 a y)) > 0}. A similar argument applies for (|3.2[) with now the 
characteristic polynomial 

d-l 

c(t) = det(i/-H d (-0 fe y)) - (-l) d c(-*) = t d + £p dfc (6, y) t k , teR. 

So with y and d fixed, a 1— > Pdk(a,y) is a univariate polynomial for every k, and 
so the conditions (|3.ip provide a bound of the form a < a d for some a d since if a 
satisfies (13. 1[) then so does a' < a. Similarly, the conditions p.2[) provide a bound of 
the form b>b d since if 6 satisfies p.2[) then so does b' > b. The scalar a d (resp. bd) 
may be taken as the smallest (resp. largest) root of the polynomial x H> Pdo(x,y); 
bounds in terms of the coefficients of Pdo(x, y) are available in the literature. 
Finally (I3.3p - p.6p are obtained with d = 1 in which case (|3.1|) and (|3.2p read: 



2/1 

2/2 



02/0 
a2/i 



2/2 
2/3 



a2/i 
aj/2 



t 0; 



&2/o 
&2/i 



2/1 
2/2 



6yi 
by2 



2/2 

2/3 



>- 0. 



□ 
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3.2. Computing the smallest interval [a, b] D supp/i. 

Theorem 13.21 provides bounds (some of them explicit) in terms of bounds on 
the largest (or smallest) root of some univariate polynomial whose coefficients are 
polynomials in y. But one may also get numerical sharp bounds via solving the 
following sequence of semidefinite programs, indexed by d: 

(3.7) a d = max {a : H d (# a y) ^ } 

a 

(3.8) b d = min {b : H d {6 b y) h0}, 

b 

where Hd(9* y) is the localizing matrix associated with the polynomial G M[x], 
Observe that (|3.7|) and (|3.8[) are semidefinite programs with only one variable! For 
instance for d = 1 , (|3.7p reads 

ai = max < a : 
a I 

whereas (|3.8|) reads 

bi = min < b : 
b I 

For more details on semidefinite programming the interested reader is referred to 
e.g. [5]. And we obtain: 

Theorem 3.3. Let /i be a finite Borel measure with all moments y = (y^) finite. 
Then supp^t C [a*, b*], with possibly a* = —oo and/or b* = +oo. and where: 

(i) a d is an optimal solution of {3. 7| ) for all d G N, and the sequence (ad), d £ N, 
is monotone nonincreasing with a d -l a* as d — > oo. 

(ii) b d is an optimal solution of VS. 8\) for all d G N, and and the sequence (b d ), 
d G N, is monotone nondecreasing with b d t a* as d oo. 

(Hi) a* (resp. b* ) is the largest (resp. smallest) scalar such that supp [i C [a*, b*\. 

Proof. We prove the statements for (i) and (iii) only because similar arguments hold 
for (ii). We first prove that (|3.7[) has always a feasible solution. If supp fi C [a, +oo) 
for some a > —oo, then a is obviously feasible for the semidefinite program (|3.7I) . 
for every d G N. If there is no such a, consider the finite sequence of moments 
Yd = (yo, ■ ■ ■ , V2d+i)- By Tchakaloff 's theorem (see e.g. [TJ [S], [Tj Theorem B.12]) 
there exists a measure v supported on finitely many points xq < x\ < ■ ■ ■ < x t , 
with t < 2d + 2 (hence suppi^ = U- =0 {iEi} C [xq, +oo)), and with same moments 
as (j,, up to degree 2d + 1. Hence in view of what precedes, xo is feasible for (|3.7p . 
Next, as every feasible solution is bounded above by yi/yo and as we maximize, it 
follows that (I3.7[) has an optimal solution ad for every d GN. 

Next, observe that ad < au whenever d > k because the feasible set of (|3 . T[) for 
d is contained in that for k and every feasible solution is bounded above by yi/yo- 
Therefore the sequence (ad), d G N, is monotone nonincreasing and thus, converges 
to a* with possibly a* = — oo. 

If a* = —oo then there is no a such that supp fi C [a, +oo) because we would have 
ad > a for all d. Next, consider the case a* > —oo, and let d G N be fixed. Using 
Hd(#a d y) h and the continuity of a M> Hd(8 a y), one obtains Hd(0 a * y) h 0. As 
d fixed was arbitrary, we then obtain Hd(9 a * y) h for every d G N. But then by 
Theorem 3.2], /i is supported on the set {x : 9 a *(x) > 0}, which shows that 
supp |iC [a*, +oo). 



Vx - ay y 2 - ayi 
V2 - ayi y 3 - ay 2 




bya - yi byi - y 2 
byi - 2/2 by 2 - t/3 
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Concerning (iii), if a* > — oo then a* is the largest a such that supp \l C [a, +00) 
because if supp^ C [a, +00) then a is feasible for p.7[) . for every d e N; therefore, 
a < for every d, which in turn implies a < a* . □ 

Next, in the case where /i is known to have compact support one may even 
consider the following single hierarchy of semidefinite programs 

(3.9) Pd = mm{b-a : H d (0 a y), H rf (-0 b y) h } , 

6, a 

indexed by d, and with now two variables a and b. We obtain the following result 
of which the proof is omitted. 

Corollary 3.4. Assume that /i has compact support. Then: 

(a) The semidefinite program \3. 9\) has an optimal solution (ad,bd) for every 

dem. 

(b) Let (ad,bd), d S N, be a sequence of optimal solutions of H3.9\) . As d — > 00, 
(cid,bd) (a*,b*) and supp // C [a*, b*]. Moreover, [a*, b*] is the smallest interval 
which contains supp/i and if the support of fi is an interval then supp/i = [a*, b*]. 



3.3. Duality. We interpret the dual of the semidefinite program (|3.7|) . Let Sd C 

jj(rf+i)x(d+i) |_ ne cone f rea i symmetric matrices. The dual of Q3.7P is the 
semidefinite program: 

(310) a * d = ££l ^y)^) 

s.t. (H rf (y),Z) = 1; Z>:0. 

If Z >z is feasible, using the singular value decomposition of Z one may write 
Z = J2i f° r some vectors (fj) C and so 

1 = (H d (y),Z) = ^f i ,H d (y)f i )=^] J f* d» = J a dp, 

with cr — J2iff e ^Nrf) an d similarly 

(H d (xy),Z) - ^(f 4 ,H d (xy)f 2 }=^ / xf^xfd^x) = / ^(ar)^*). 

Therefore, equivalently, (|3.10j) reads 



(3.11) a* d — min < / x o~(x)dfj,(x) : J a d/i = 1 

dv{x) dv 

and > a d (which is called weak duality). Indeed, for any two feasible solutions 
a, Z of (|3.9p and (|3.10l) respectively, using Z ^ and H d (6 a y) >; 0, yields 

0< (Z, H d (6' a y)) = J (x ~ a) a(x) dfi(x) = J xa(x) dfi(x) - a, 

that is, a < J xa(x)dfx(x). So in the dual semidefinite program (13.111) . one searches 
for a sum of squares polynomial a e £[a:]d of degree at most 2e? (normalized to 
satisfy J adfi — 1), which minimizes J xadfi. Equivalently, one searches for a 
probability measure v with density a € S[x]d with respect to /1, which minimizes 
the upper bound J xdv on the global minimum of x on the support of [i. 
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Similarly, the dual of ([3. 8(1 is the semidefinite program: 



(3.12) b* d — max < / x a{x)dfjb{x) : J ad/j, = ] 

dv(x) dv 

Again, by weak duality, b* d < bd and in (13. 12)) one searches for a probability measure 
v with density a € S[a;]d with respect to /i, which maximizes the lower bound J xdv 
on the global maximum of x on the support of /i. 

Theorem 3.5. Suppose that /i is such that Hd(y) >- for all d (for instance if \x 
has no atom). Then there is no duality gap between \3. 7| ) and \3.11\) (resp. i3.8\) 
and i3.12\) ). i.e. ad = a* d (resp. bd — b* d ). In addition H3.11\) (resp. \3.12) ) has an 
optimal solution a* € £[x]<j (resp. ip* € H[x]d), and 

(3.13) J(x- a d ) cr*(x) dn(x) = = J{b d -x) tp*(x) dfi(x). 

Proof. From Theorem I3.31 we know that Q3.7P has an optimal solution a<j. By 
Tchakaloff 's theorem, let v be the measure supported on the finitely many points 
Xq, . . . , x t (with t < 2d + 2), and with same moments as up to degree 2d + 1. 
There are positive weights k = 1, . . . , t, such that 

/ pd[i = I pdv = ^2 ^kP{xk) Vp £ R[x] 2 d+i 

J k=0 

(see e.g. [TJ [5]). Hence H d (0 a y) >- for every a < x , because for every f (/ 0) G 
R d+1 (hence every / 0) e R[x] d ), (f , M d (y)f) = \ k f(x k f > 0, and so 

(f,H d (0 a y)f) = J f(x) 2 (x-a)d f i(x) 

= / f{xf(x-a)dv(x) = ^f{x k ) 2 (x k -a)X k > 0. 

J k=0 

Hence every a < xq is strictly feasible for (|3.7[) . that is, Slater's condition^ holds. 
But this implies that there is no duality gap, i.e., ad = a*,, and in addition, the 
dual (|3.11j) has an optimal solution er*; see e.g. [9]. For same reasons, bd = b* d and 
(|3.12[) has an optimal solution. Therefore, 



= / xa* (x)dfi(x) — a* d = J (x — a* d )a* (x)d[±(x) — J (x — ad)cr* (x)dfj,(x), 
and similarly, 

= b d — J xip*(x)dfi(x) — J (b d — x)ip* (x)dfi(x) — J (b d — x)ip* (x)dfi(x) , 

which is the desired result (|3.13[) . □ 

In Theorem 13.51 write a* £ E[x]d as a* — ^2 e p 2 for some polynomials (pi) C 
R[x]d, with respective coefficient vectors pd G Then by (|3.13p 

/ <r*(x)(x - a d )dfi(x) = ^ / pe(x) 2 (x - a d )dfj,(x) = ^ {p e , B. d (9 ad y)pe) = 0, 



2 For a convex optimization problem min x { /(x) : 9j(x) > 0, j = 1, . . . , m}, Slater's condition 
states that there exists xq such that gj(xo) > for every j = 1, ,m. 



8 



JEAN B. LASSERRE 



so that for every £, (pi,H d (0a d y)pe) = (since H d (#a d y) h 0), that is, every 
is in the kernel of Hd(0 ad y). 
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